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THE CLAIMS DEFINING THE INVENTION ARE AS FOLLOWS : 

1. A telecommunications/computer system having a plurality of nodes, such 
that the plurality of nodes are clustered in a plurality of interconnected 
neighborhoods, the system characterised in that a relatively small number 

5 of cross-links are provided between nodes of different neighborhoods. 

2. The system of claim 2 wherein the relatively small number of connections 
are random links. 

10 3. The system of claim 2 or 3 wherein the neighborhoods are fully 
interconnected. 

4. The system of claim 1 wherein the mean connectivity between nodes of 
different neighborhoods is in the range of about 1 .5 to 2.0. 

15 

5. The system of claim 1 wherein the mean connectivity between nodes of 
different neighborhoods is about 1 .6. 

6. A large scale computer system including a multiplicity of nodes, each node 
20 having a plurality of interconnected processors, said nodes being arranged 

in a network with neighboring sets of nodes of the network forming 
neighborhoods of fully interconnected nodes, wherein random links are 
provided between nodes of different neighborhoods in the network whereby 
each processor of the system can communicate effectively with other 
25 processors regardless of their location in the network without full 

connectivity in the network. 

7. A scalable computer system formed using a small world principle. 
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A SCALABLE COMPUTER SYSTEM 



FIELD OF THE INVENTION 

This invention relates to computer systems and more particularly, but not 
5 exclusively, to a computer system which is required to have a large number of 
computer processors for use in large scale system applications. The present 
invention has application to scalable telecommunications and intelligent networks. 
BACKGROUND ART 

Recent developments in telecommunications and intelligent networks, 

10 primarily involving the field of photonics, are resulting in a rapid expansion of 
bandwidths available for communication. The available bandwidth is currently 
growing at a rate involving, roughly, a factor of two every two years, and it is 
anticipated that communication bandwidths may increase by at least three orders 
of magnitude over the next ten years. 

15 In order to match this rapid bandwidth growth in the level of 

telecommunications, equivalent computing power is required. It is therefore 
desirable to design a computer based system architecture that is massively 
scalable. The scalability is essentially driven by the number of independent users, 
as in mobile phone devices, rather than the complexity or size of an individual 

20 application. 

Hitherto, there has been no known solution to the problem of designing a 
massively scalable architecture for the intelligent network (IN) domain. 

The Internet is a large computer system, but it is a hierarchical system and 
hence does not address the issue of massive scalability. 
25 Other computer system architectures that are known are only scalable in 

many orders of magnitude less than what will be required in the near future in 
telecommunications and intelligent networks. 

For example, the computer system of Figure 1 is based on an Eriang/Open 
Telecom Platform (OTP) running on a single node. The computer system 10 
30 includes hardware 12, an operating system 14, a display 16 and a keyboard 18 
and a suite of programs 20 which include application programs 22 (eg. in 
programming languages, Eriang and C), sourced programs 24, run-time programs 
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26, a library 28, and a database 30. The system may be linked to an external 
database 32 if required. 

The single node provides reasonable system development facilities, 
including an Eriang real time environment, or interpretive environment. However, 
5 this is achieved at the expense of potential performance owing to the 
interpreter/operating system layers. 

The single node computer system of Figure 1 may be linked to other similar 
nodes by an asynchronous transfer node (ATM) switch, such as the AXD-301 
switch with satisfactory performance. However, this switch has a scalability of 

10 1:30, which is orders of magnitude less than that which is required for ultra high 
communication bandwidths. 

Referring to Figure 2, there is shown a split node computer system in which 
an OTP node 34 is split into two closely couple nodes: a COTS (commodity of the 
shelf) system 40 and a multi-processor (MP) Eriang Engine 50. The COTS 

15 system is essentially the base system and may comprise of a UNIX operating 
platform 41, application programs (eg. in C, C++, Java and Eriang) 42. a disc drive 
43, graphics 44, an Internet modem 45, an Internet interface (TCP/IP) 46 and an 
input/output interface (I/O) 47 for communicating with the Eriang Engine 50. 

The Eriang Engine 50 is a shared memory MP system running software 52 

20 and 54 in Eriang on top of an optimized message passing kernel (56) such as 
QNX. The Eriang Engine 50 also has an I/O interface 58 for communicating with 
the COTS system 40. One processor of the MP set can be devoted to monitoring 
software, the remainder to functional processing. 

The split node OTP system 34 of Figure 2 may form part of a network that 

25 includes a plurality of regional processors (RP) 61 and support processors (SP) 62 
for operators. The regional and support processors 61, 62 are connected to 
central processors CP A 63 and CP B 64 and to each other by a high speed RP 
bus 65. The MP Eriang Engine 50 includes a high speed interface 59 for 
communicating with the central processors CP A 63 and CP B 64. 

30 The split node OTP system 34 can be linked to other computer systems by 

a switch 70 such as an AXE-10. For this purpose an AXE programming system 
(APS) 72 may be provided. In a telecommunications application, the interface 
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shown to the AXE-10 may be implemented as a high speed Ethemet, primarily 
due to the availability of the Ethemet PLEX (Programming Language for 
Exchanges) blocks existing on AXE-10. The Eriang to PLEX interface has been 
demonstrated in two modes, firstly with the AXE-10 controlling the links, as in a 
5 call fonwarding application. The second mode is with OTP in control, with an 
application such as remote changes to AXE-10 tariff tables. 

The scalability limit of the Eriang Engine is a maximum of eight processors, 
given that it is a shared memory environment. The eight processors, together with 
a demonstrated 5 x speed up from the move to compiled code, plus 2 x moving 

10 from Unix to QNX gives a scale-up of 80 from the base system. 

Therefore it is apparent that both of these known systems have limitations 
in terms of their scalability and could not be considered massively scalable. 

It is therefore desirable to provide a massively scalable computer system 
including a large number of processors in which each processor can communicate 

15 effectively with other processors without regard to their locations. 
SUMMARY OF THE INVENTION 

According to one aspect the present invention provides a 
telecommunications system having a plurality of nodes, such that the plurality of 
nodes are clustered in a plurality of interconnected neighborhoods, the system 

20 characterised in that a relatively small number of cross*links are provided between 
nodes of different neighborhoods. 

According to another aspect, the present invention provides a large scale 
computer system including a multiplicity of nodes, each node having a plurality of 
interconnected processors, said nodes being arranged in a network with 

25 neighbouring sets of nodes of the network forming neighbourhoods of fully 
interconnected nodes, wherein random links are provided between nodes of 
different neighbourhoods In the network whereby each processor of the system 
can communicate effectively with other processors regardless of their location in 
the network without full connectivity in the network. 

30 In essence, the present invention has come about through the realisation 

that problems associated with telecommunication and intelligent network 
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scalability and/or computer architecture design, can be addressed by applying the 
"small world" principle. 

The "small world" concept was derived from the "six degrees of separation" 
principle. Six degrees of separation is a theory that a person may reach anyone in 
5 the world through at the most six personal contacts. This theory was explored 
through an Internet site based upon the actor Kevin Bacon. This site was created 
out of curiosity, but was a very useful sociological experiment for illustrating the six 
degrees of separation principle. The site however, gave no hint as to any 
underlying structure of the people involved in the interconnections. 

10 The key to the underlying structure may be derived from studies into 

epidemics. For example diseases, such as the Black Death spread with great 
rapidity from one part of the world to another: from the Middle East to Europe. In 
that situation, the epidemic mechanism was that of an area that already had the 
disease within a defined group, and a single vector, such as ship-borne rats 

15 travelling to another defined group. 

By understanding the relationship between epidemics and the six degrees 
of separation principle, it is apparent that the underlying structure of the six 
degrees of separation principle was a set of richly connected groups with a small 
number of inter-group links. It is this combination of richly connected 

20 neighborhoods, with a small number of links between them that Is termed a "small 
wortd" network. 

In other words, the present invention utilizes a "small-worid" network 
architecture, in which a relatively small number of random cross-links of nodes or 
vertices In a network can result in small characteristic path lengths, for the transfer 
25 of messages between nodes or vertices In a telecommunications/computer 
network regardless of their location.. 
BRIEF DESCRIPTION OF THE DRAWINGS 

A preferred embodiment of the present invention will now be described, by way of 
example only, with reference to the accompanying drawings in which: - 
30 Figure 1 Is a diagram of a prior art single node computer system, which has 

limited scalability; 

Figure 2 is a diagram of a prior art split node computer system; 
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Figure 3 is a diagram showing the difference between a "small world" 
network and regular ring and random networks; 

Figure 4 is a graph showing variations in clustering and average path length 
with increasing randomness in a ring network. 
5 Figure 5 is a diagram of a four-node computer system having four 

processors per node. 

Figure 6 is a diagram of a small-world architecture for a computer system in 
accordance with the invention. 
DETAILED DESCRIPTION 
10 The "small world" principle is usually considered to apply to many biological 

and social networks, as these systems generally exhibit properties that are not 
completely regular or completely random but somewhere in between. For 
example, infectious diseases exhibit "small world" properties. In this regard, it has 
been shown that infectious diseases spread more easily in small world networks 
15 than regular lattices. 

The present invention applies this small world principle to 
telecommunications/computer networks. A comparison of the performance of a 
small world telecommunications network, to that of regular and random 
telecommunications networks will now be provided. Examples of regular, small- 
20 world and random networks are shown in Figure 3. 

In very large telecommunications networks with only local connections most 
vertices or nodes in the network are separated by many links. In regular lattice or 
ring structures with local connections between vertices or nodes, the characteristic 
or mean distance of the path length (L) between two vertices or nodes grows 
25 approximately linearly with the size of the network. On the other hand, in a 
network with only random connections between vertices or nodes, the 
characteristic path length (L) grows logarithmically with the number of vertices or 
nodes. A network with only random connections, however, is a poorly clustered 
environment, as a sparse number of random connections can result in some 
30 vertices or nodes not being inter-connected to other nodes at all. 

A small world telecommunications network in accordance with the present 
invention Is one in which vertices or nodes in local "neighborhoods" or "clusters" 
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are interconnected to each other, and a relatively small number of random links or 
connections are provided between nodes of different neighborhoods of the 
network. 

In "Collective dynamics of "small-world networks" by Duncan J, Watts & 
5 Steven H. Strogatz, Nature, Vol. 393, pp. 440-442, a mathematical approach to 
defining structural properties of small-world networks was provided in terms of 
characteristic path length L(p) and clustering coefficient C(p). L(p) measures the 
typical separation between two vertices in a network (a global property) and C(p) 
measures the clustering or connections in a typical neighborhood (a local 
10 property), where p is a probability factor. 

In a regular network having n nodes and k edges or links per nodes, p = 0, 
L (0) grows linearly with n, the number of nodes in the network, and C(0) depends 
on the specific geometry or 'wiring' of the network. 

In a completely random network with only random connections, p = 1 and L- 
15 random grows logarithmically with n, whereas C-random ~ k/n « 1 . 

"Small-world" networks, on the other hand, have a broad interval of p over 
which L(p) is almost small as L random, yet C(p) is much greater than C-random. 
This is shown in the graph of Figure 4, 

Watts and Strogatz thus demonstrated numerically that a few random 
20 global connections are sufficient to turn a regular network into a small-worid 
network to reduce the path length of the number of links for effective 
communication between nodes or vertices drastically. 

Hanspeter Herzel in his article entitled "How to Quantify Small-World 
Networks" (Fractals. Vol. 6, No. 4 (1998) 301-303) derived a formula for the mean 
25 connectivity k^ of nodes in a small-world ring network. For a ring network with k 
edges of links per node, in which a fraction of p connections are re-wired randomly 
the formula was: 

k^ = k . p 

When k^ > 1, the characteristic path length L(p) may be expressed as 
30 follows: 
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ln(n) 



ln(n) 



L(P) = 



ln(k) + ln(p) 



Such a logarithmic curve approximates the curve L(p)/L(0) in Figure 4. 

In the present invention, the number of nodes in the network, the number of 
nodes in the neighborhood, the number of nodes per neighborhood and the 
number of cross-links in the network may each be varied for different applications, 
provided that the network functions as a small-world network with large clustering 
C(p) and small average path lengths L(p). 

The cross-links in the small-world network of the present invention may be 
chosen completely at random. Alternatively, a pseudo-random selection process 
may be used to select the cross-links between neighborhoods to convert a regular 
network into a highly clustered small-world network with a relatively small average 
path length. In this regard, an acceptable result in terms of the number of hops 
per inter-process message, from a system process point-of-view. Is under two. 

In one preferred embodiment of the invention a mean connectivity falling 
substantially in the range from about 1.5 to about 2.0, and preferably about 1.6, 
may be achieved by appropriate choice of the number of nodes per neighborhood, 
the connectivity of each neighborhood and/or the number of cross-links relative to 
the total number of nodes in the network. By way of example, in a computer 
system having 50 neighborhoods of 10 nodes arranged in a ring network with 
about 50 cross-links between neighborhoods, each node is connected to 9 other 
nodes in its neighborhood (k = 9) and the probability factor p = 50 x 2/500. Thus 

k"* = 9x 100 = 1.8 



The number of interconnected processors in each node of the computer 
system may also vary for different applications. With the development of 
photonics. It is envisaged that up to about 256 nodes, each containing up to eight 
processors per node may be fully connected together by optical fibres and a high 
speed switch to form a single neighborhood in a small-world network. With a large 
number of such neighborhoods in the small-world network connected by a 
relatively small number of cross-links, it is possible to achieve a massively 



500 
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scalable computer system with a very large number of total processors in the 
system which are able to communicate with each other in an effective manner. 

There will now be explained with reference to Figure 6, an example of how 
a "small-world" network architecture can be used to achieve a large scale 
computer system of about one million processors in which each processor of the 
system is able to communicate effectively with other processors in the system 
without requiring full connectivity. 

Figure 6 shows a small-world telecommunications network in which there 
are 20 nodes arranged in a ring layout. The 20 nodes of the ring network can be 
considered to form five neighborhoods of nodes A, B, C, D and E in which there 
are four nodes (A, to A^; B, to B^; C, to C^; D, to D^; and E, to EJ per neighborhood. 

Each node eg A2 is connected to adjacent nodes A^, A3 by an edge link EL 
and alternate nodes eg A,, A3; Ag, A^; A3, B, are connected to each other by a small 
loop link LL. 

A network connected only in this manner would normally be termed a 
regular network in which messages from one node, eg A,, must pass through a 
relatively large number of links to reach a node at the opposite side of the network, 
eg C,. 

A small-world network such as shown in Figure 6, differs from a regular 
network in that a relatively small number of random cross-links are provided 
between neighborhoods of nodes. In the example of Figure 6, there are three 
cross-links CL„ CL^ and CL3. Cross-link CL, directly connects nodes Aj and C, 
with each other; cross-link CLg directly connects nodes and E3 with each other 
and cross-link CL3 directly connects nodes and E^ with each other. It will be 
apparent from Figure 6 that there is a marked increase in connectivity with only a 
relatively small number of cross-links between neighborhoods of nodes. For 
instance, a message to be sent from node A, to can pass along an edge link EL 
to node A^, along cross-link CL, to and then along an edge link to C^. This is a 
clear improvement over a regularly connected network, where the message would 
pass along four loop links to C, and an edge link EL to Cg. Also, a message from 
B4 to E2 can pass along a loop link to B^, along cross-link CL^ to E^ and then along 
another loop link LL to Eg, rather than along five loop links. 
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It will be seen from Figure 6 that a small-world network is an architecture 
that can be used to link together a relatively large number of computer processors 
while retaining effective connectivity between the processors. 

In a preferred embodiment of the invention, each neighborhood of Figure 6 
5 corresponds to the four-node/four-process per node computer system shown in 
Figure 5. Referring to Figure 5, there is shown a system that demonstrates it is 
possible to link up several MP Eriang Engines of the type shown in Figure 2 
through a high-speed blocking switch. Each node of the computer system of 
Figure 5 is an Eriang Engine 150 with four processors 152 running on a QNX 
10 kernel 156. Each Eriang Engine 150 may include a link to an OTP system 134 in 
similar manner to split node system of Figure 2 and may also have a local Internet 
connection 145. 

The Eriang Engines 150 are connected to each other by optical interfaces 
160, optical fibres 165 and a common high speed non-blocking optical switch 170. 
15 Each optical interface 160 may include at least one optical receiver 161 and one 
or more optical transmitters 162. 

Currently available interface blocks 160 can handle 32 separate 
wavelengths: this is predicted to rise to 256 with further developments in 
photonics. This will permit up to 256 nodes (Eriang Engines) in a computer 
20 system such as that of Figure 5, as each node can be essentially addressed by an 
individual wavelength. 

A key attribute of the system of Figure 5 is that the interface blocks can 
transmit one or more wavelengths, up to 256, with the same data simultaneously 
as a multicast facility. However, each node only receives on one wavelength: its 
25 address. 

Since the system gives almost linear scaling on separable problems, 256 
nodes can give a speed-up of 20,000 over the basic system. 

It will be noted that the computer system of Figure 5 is a fully connected 
system in the sense that each Eriang Engine 150 has its own dedicated optical 
30 fibre link 1 65 to the central switch 1 70. 

Applying the system of Figure 5 to the small world network of Figure 6, it is 
apparent that even where each neighborhood is a four node/four processors per 
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node system, a total of eighty processors can be effectively linked together by the 
20 node network of Figure 6 with only 3 cross-links. 

It is however, to be appreciated that the small-world network of Figure 6 is, 
however, only a relatively small-scale example of such a network. Within the 
5 scope of the present invention it is contemplated that at least 500 neighborhoods 
of nodes each having up to 256 fully connected Eriang Engines per node with 8 
processors per Eriang Engine could be linked together in a small-world network to 
achieve a total system of over one million processors, with the small-world network 
architecture providing effective connectivity between the nodes with only a 

10 relatively small number of cross-links, say 50, between the neighborhoods. For 
example, the total number of individual Eriang processors running on such a 
system will be of the order of 256,000,000 assuming 2000 active processors per 
Eriang Engine node. This gives around 25.6 million lines of code, which is of the 
order of magnitude already envisaged for large software systems project. 

15 It is envisaged that a massively scalable computer system in accordance 

with the invention has widespread applications. In the telecommunications field, 
the scalability could cover applications such as mobile telephone services for 
stockbroking, betting and other services. The invention may also be applied to 
Internet proxy servers in order to accommodate an escalating number of users. 

20 More particularly in relation to the mobile telecommunications field, the 

present invention may be used as a "personal information manager In the sky" 
whereby it coordinates communications with handheld communications devices, 
such as Personal Digital Assistants (PDAs). 

A further application is microbank applications, whereby the present 

25 invention may be used by financial institutions in order to allow them to 
economically handle extremely large numbers of transactions, particularly relating 
to very small amounts. 

It will be appreciated that various modifications and alterations may be 
made to the present invention as described above without departing from the 

30 scope and spirit of the present invention. For instance, as mentioned above, the 
size of the network, the neighborhoods in the network, the number of nodes per 
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neighborhood, the number of cross-links between neighborhoods and the number 
of processors per node may be varied for different applications. 
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THE CLAIMS DEFINING THE INVENTION ARE AS FOLLOWS: 



1. A telecommunications/computer system having a plurality of nodes, such 
that the plurality of nodes are clustered in a plurality of interconnected 
neighborhoods, the system characterised in that a relatively small number 

5 of cross-links are provided between nodes of different neighborhoods. 

2. The system of claim 2 wherein the relatively small number of connections 
are random links. 

10 3. The system of claim 2 or 3 wherein the neighborhoods are fully 
interconnected. 

4. The system of claim 1 wherein the mean connectivity between nodes of 
different neighborhoods is in the range of about 1 .5 to 2.0. 

15 

5. The system of claim 1 wherein the mean connectivity between nodes of 
different neighborhoods is about 1 .6. 

6. A large scale computer system including a multiplicity of nodes, each node 
20 having a plurality of interconnected processors, said nodes being arranged 

in a network with neighboring sets of nodes of the network forming 
neighborhoods of fully interconnected nodes, wherein random links are 
provided between nodes of different neighborhoods in the network whereby 
each processor of the system can communicate effectively with other 
25 processors regardless of their location in the network without full 

connectivity in the network. 



30 



7. 



A scalable computer system formed using a small world principle. 
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